DOCUMENT RESUME 



ED 227 301 

AUTHOR 
TITLE 

INSTITUTION 
SPONS AGENCY 

PUB DATE 
CONTRACT 
NOTE . 
PUB TYPE 

EDRS PRICE 
DESCRIPTORS 



CE 035 334 

Rice , Eric 

Evaluating Apprentice Performance, Instructor 
Training Module #9. 
Conserva, Inc. , Raleigh, N.C. 

Office of Vocational and A^ult Education (ED) , 

Washington f DC-. 

82 

300-80-0937 

36p.; For related documents, see CE 035 315-335. 
Guides - Classroom Use - Guides (for Teachers) (0E>2) 

MF01/PC02 Plus Postage. 

^Academic Achievement? ^Apprenticeships ; Discussion 
(Teaching Technique); Educational Certificates; 
Evaluation Criteria; *Evaluation Methods; Inservice 
Teacher Education; Postsecondary Education; *Student 
Certification ; *Studeht Evaluation ; *Work 
Attitudes 



ABSTRACT , 

Part of a series of instructor training modules on 
related subjects instruction for apprentices, this booklet deals with 
evaluating apprentice performance. The first chapter consists of an 
outline of the scope an<J content of the 'instructor training modules 
as well atf a self -assessment pretest. Covered in the module are . 
assessing* apprentice knowledge and skills , assessing apprentice 
work-related attitude^ and values, discussing individual evaluation 
results with apprentice learners, and developing instruction to 
certify skills and knowledge upon completion of the program or 
course. Each chapter contains some or .all of the following: an 
introduction- and objectives, instructional text, an example, 
additional information, and self-test exercises.' Appended to the 
booklet are answers to the Self-test exercises, a posttest, and 
answers to the posttest. (MN) 
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The words on this list are used in this booklet. Please review the terms and learn the definitions, the meanings of the 
words as used in the text mav^not be the form of the word with which you are familiar. 

Words /Terms 

1. Anecjotal In the form of a short narrative statement about an incident or behavior usually as related by an 

observer 

2. Application A use to which something is put ' \ 

3. Appropriate Fitting or especially suitable \ 

4. Assess To determine the impprtance, size or value of something 

*> Attitude A feeling, emotion, posture and subsequent behavior toward a fact, state or situation 

b Certxly To confirm or inform with certainty in a formal way to someone else, some set of facts or results 

Confirmation Jlie support of an idea or conclusion through evidence 
8 \qnjjtmction 3pe state of being joined together 

9. Consensus Atffldgement arrived at or agreed to by a group 

10. Continually Incurring indefinitely 

1 1 Evaluation We process of determining the value of an object, program, or effort 
12. Explicit Cleffifnd publicly stated , 

13 Invaluable #great worth / 
* 14 Interaction Hutual influence or discussion 

* 15 Legitimacy Jglceptability within general rules and standards 

16 Limitation Restriction or boundary 

17 Negative conduction Using the words Not or Never in sentences 

18 Norms Expected, average behavior 

19 Performance^ The execution of action or activity in accord with fulfilling some expected requirement 

20. Periodically Occurring over time at expected intervals 

21. Performance Achievement Testing The type of assessment that foe uses on what a learner actually knows and can 

do as well as how well he/she can do it. 

22. Plausible Appearing worthy of belief 

23. Prescribe To lay down a rule 

24. Prespecified Laid out or indicate^ in detail or explicitly as a rule before an activity pecurs 
25 Orientation The usual general or lasting direction of thought or position 

26. Representative Serving as typical example 

27. - Scenario An outline or account of a proposed course of action or events 
2%. Self Reporting Answering for one's self 

29. Specification A detailed or explicitly stated expectation * 

30. Testing The process of collecting jiata or information on a sample of behavior or performances 
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1. How To Use This Booklet 



What Is The Series About? 

Related subjects instruction is an essential part of every 
apprenticeship program It is the program component 
through which apprentices are taught the background 
theory- and range of application of associated technical 
subjects such as mathematics, science and safety Related 
instruction usually takes place in a classroom, after the 
regular work is over Most frequently, related instruction is 
taught by a skilled tradesperson or craftworker For the 
tradesperson or craftworker to be an effective trainer, he or 
she must not only know their trade skills, but also they 
must use teaching skills appropriate for conveying that 
information to apprentices. This series of materials is written 

,to train related subjects instructors in the critical teaching 
skills necessary to perform their jobs effectively. The titles 

„ of the booklets in the series are: 

1. Introduction to Related Subjects Instruction and In- 
Service Training Materials 

2. Planning the Apprenticeship Program 

3. Planning Related Subjects Instruction 

4 . Developing Instructional Materials for Apprentices 

5. Presenting Information to Apprentices 

6. Directing learning Activities for Instruction 

7. Providing for Individual Learner Needs 

8. Controlling Instructional Settings 

9. Evaluating Apprentice Performance 

10. Communicating with Apprentices 

The first booklet introduces the series, describes the con- 
tent of each booklet, and provides an overview of appren- 
ticeship and of adult learners The second booklet describes 
how to plan an apprenticeship program and may be used 
by related instructors, sponsors or service agencies. Each of 
the other eight booklets deals wjth a set of training skills 
judged by a panel of experts on apprenticeship tp be critical 
to working effectively as a related subjects instructor. 



What Is This Booklet About?, 

Each of us evaluates options beforejftaking decisions. 
We consider alternative materials andlfoots to use to finish 
a job; we judge the positive and negative aspects of different 
car makes before making a purchase; we examine products 
before deciding if a job was done correctfy. In each instance, 
we consider, judge; and value information. Based on our 



judgment— or evaluation— we make decisions and take 
action. • % 

As a related instructor, you must evaluate apprentice per- 
formance. You must determine if apprentices are learning 
the necessary skills, attitudes and knowledges to work as 
competent journbyworkers. Further, you must report to the 
program sponsor apprentice progress in mastering this 
content. To perform effectively in these tasks, you must use . 
a vanety of skills associated with developing and using tests 
and test results. This booklet provides instruction in four of 
the most important skills involved with evaluating appren- 
tice performance: 

1. Assess Apprentice Knowledge and Skills 

2. Devise/Use Instruments to Assess Work Attitudes and 

Traits 

3. Discuss Individual Evaluation Results with Apprentices 

4. Develop instrumentation to Certify Skills Upon Com- 
pletion of Course 

What Must I Do To Complete 
My Work In This Booklet? 

Working your way through this booklet will require you 
to read the text, to answer the questions, to perform the 
exercises, and to complete the pre and post assessment 
instruments. Expect to spend about five hours working 
through the materials. The only resources you need to" 
complete your work in this booklet are: (1) a copy of the 
booklet; (2) a pencil or pen; (3) about two hours of time; 
' and (4) recollection of past related instruction experiences. 

The materials are written in a self-instructional, program- 
med format. You rfiay work through the text, examples and 
questions at your own pace and leisure; you need not 
complete your work in the booklet at one sitting. 
' Each chapter in the booklet is devoted to a single skill. 
The general format of the chapters is similar, with the 
following parts: 

1. An introduction describing the skill and the instruc- 
tional objectives for that skill. 

2. What is, when and why\o use the skill 

3. Step by step directions for how to perform the skill - 

4. An example oi how the skill is used in related instruc- 
tion. 

5. A self test exercise to apply the information about the 
skill. 




2 Evaluating Apprentice Performance 

6_ Additional sources of mjortnatton. 

This booklet concludes with an appendix that contaios 
the answers to the self test exercises from each chapter and 
the posttest. 

Your activities in working through this booklet sgll in 
elude, in order, the following things * 

• Complete ity selfassessm'ent; 

• Read and consider in detail the introduction and 
objectives for each skill; 

• Read and study the text, examples and illustrations 
/ provided for each skill; 

• Complete the self-test exercise for chapter and com- 
pare your answers with those provided in the appen- 
dix, • , 

• If you complete the exercise as directed continue 
your work in the booklet; if you fail to answer the 
questions correctly, repeat your work in the chapter 
under consideration; and 

• At the conclusion of the booklet, complete the post- 
test for the unit. Check your answers against those 
provided. If you exceed the criteria, continue your 
work in the nest booklet. If you fail to demonstrate 
mastery, repeat portions of tjjiis booklet as needed. 



How Much Do I Know About__ 
"^"Thef Subject Beforef I Begin? 

The self-assessment will assist you to focus on compe 
tency areas associated with evaluating apprentice perfor- 
mance. Read each competency statement listed in Figure 1 
and assess your level of knowledge about and your level of 
skill in performing that task. Knowledge means what you 
know about the subject while skill meins your experience 
in successfully performing the task. Circle the number that 
best describes your level of knowledge and skill. Compe- 
tencies where your ratings are poor or fair are those that 
you should concentrate on. Pay particular attention to the 
chapters which deal with those ^competencies. 
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.Figure 1. Evaluating Apprentice Performance 
Self-Assessment v 



Chapter 
in Book 






Rating 






Competencies 




Poor Fair 


Good 


Excellent 


£, OIV111 HooCcO 

apprentice 
knowledge and 


1 Distinguish between different tvoes of 
tests (knowledge stimulation, and 
sample) based on setting and purpose 


Knowledge 
* Skill 


1 2 

• r 2 


3 
3 


4 
4 


skill 

» 


2. Const ructitests of the work sample^ 
knowledge and simulation types - 


Knowledge 
Skill 


1 2 


3 
3 


4 

'4 




* 3. Construct(multiple choice test items 


Knowledge 
Skill 


1* 2 
1 2 


3 
3 


4 .• 
4 




4 Construct short answer test items 


Knowledge 
Skijl 


1 2- 
1 2 


3 
3 


. 4 
4 




5 Critique and correct test items . 


I\JlUWlCUgC 

Skill 


1 2 
1 2 


y 


4 

4 




6. Construct checklists 


i\nuwieuge 
Skill 


1 2 
1 2 


. 3 


4 
.4 


3. Skill. Devise and 
use instruments 
to fl^spos work 


7. Identify important work-related 
attitudes 


' m Knowledge 
Skill 


1 2 


• 3' 
3 


4 

. 4 


attitudes 
and values 


, 8. Construct and use rating scales 


Knowledge 
* Skill 


1 2 
1 ' 2 


3 
3 


4 
4 




9. Construct and use anecdotal records 


Knowledge 
Skill 


1 2 
1 2 


3 
3 


4 
4 


4. Skill: Discuss 

individual * 


10. Identify functions of discussing test 
results 


* Knowledge 
Skill 


1 . 2 
1 2 


3 
3 


4- 
.4 


evaluation results 
with apprentices 


1 L Explain and use procedures for 

discussing individual evaluation results 


Knowledge 
Skill 


1 2 
1 2 


3 
3 


4 
4 


5. Skill: Develop 
instrumentation 


12. Develop individual performance 
records ^ 


Knowledge 
Skill 


1* 2 
1 2 


, "3 
3 


4 
4 


to certify and 
report skills 


13. Develop group or long-term 
performance record 


Knowledge 
Skill 


1 2 
1 2 


3 
3 


4 

•4 ' 


upon 

completion of 
course 


* 14. Develop individual time records 


Knowledge 
Skill 


* 1 2 
1 2 


3 
3 


4 
4 
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2. Skill: Assess Apprentice 



Introduction And Objectives 

Evaluating apprentice skills and knowledgesis an essen 
tial and inescapable duty uf all related si^ectsinstructors. 
Lnfortunately,few teachers of adults, including mahy related 
studies instructors, ha\e had formal training in tasks assou 
ated with testing. Instead, evaluation skills have been learned 
thruugh tnal and errur. As a result, testing too often empha 
sizes less important information or generates infurmatiun 
thatTnay be of little use to you as an instructor^ 

The purpose of these materials is to ensure that yuu are 
not entrapped by these short comings. Working through 
these materials will sharpen your evaluatiqn skills and 
knowledges so that you and the apprentices y ou train bene 
fit from the time and effitft >ou jointly invest in assessing 
learning and performance during related instruction. VChen 
you have completed y our wOrk in this unit of materials you 
will demonstrate your competence in evaluating trainee 
knowledge and skills by being able to. 

1 Distinguish between types of tests useful for assessing 
knowledge and skills, ' . ' 

* 2 Critique sample test items, and 
• 3 State the rules for constructing various types of test 
items. 



Why, What And When To Test 

The type of testing with which you must be concerned is 
named Performance Achievement Testing '^or/ PAT' in 
this set of materials. It is well-suited to related subjects 
instruction because it is action onented and uses observable 
behavior to assess learning. J 

There are three major types of performance achievement * 
jtests, each of which is useful for related instruction evalua- 
tion. They differ mainly in the degree they resemble the 
work setting. The choice of whai type^of test to use is yours. 
Make your decision based upon the learning outcomes you 
desire and the material to be tested. The three types of tests 
are. tD work sample, "(2) simulation and (3) knowledge. 
In apprenticeship training you must attend to each type o£ 
test. In related studies, your particular concern is with simu 
lation and knowledge type tests, the work Sample test 
usually is employed in the on-the job portion of instruction. 
Each type of test is discussed on the following several pages. 
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Work Sample 

The w ork sample test is the type of performance achieve 
ment test with the highest degree of realism Use it to 
measure direct application of knowledge and skills on the 
job Usually a work sample test the sample test requires 
apprentices to demonstrate learning outcomes on the job 
by evaluating work procedures and products on a sample 
set of tasks. The sampled tasks must include the most criti 
cal elements of the skills and knowledges that have been 
taught. Also they must be representative of the total range 
of possible performance outcomes. To ins tire that you have 
selected the most critical learning outcomes to test, usually 
you and the journeyman supervisor should analyze the job 
and reach consensus about the importance of required tasks, 
skills and knowledges. To insure that the apprentice to be 
tested understands the expectations of the performance 
situation, you should write out the test directions. Include 
information about the sequence of work.activities and any 
test directions such as how to record answers, how scoring , 
will be accomplished, the value of different answers aricrV 
time limits for certain questions and tasksv* — 

Frequently a work sample test wilPinvolve several work 
stations and many apprentices. In such instances, each 
apprentice works alone at a single workstation, performing 
required tasks while other apprentices work individually at 
other work stations. Time limits afe 'placed on activity at - 
each work station. When time expires, the apprentices move 
on to another station. Learning outcomes foreacrrappren- - * - 
tice are tested at each work station. The activity at each * * 
work station should be independent of work at any oilier 
work station. Usually, because of the number of apprentices r 
and work stations, assessment will include use of checklists, 
rating scales and written learner answer sheets. A different 
test answer sheet is usually necessary for each work station. 

Simulation 

The simulation type of performance achievement test 
has a fairly high degree of.realiSm. It emphasizes the appli 
cation of necessary skills and knowledges. Simulation tests 
take one of two forms., work setting and situation. In the 
w ork setting form of simulation, the apprentice is presented 
with a problem like the type he of she will encounter on 
thejob. Emphasis is placed on using proper procedures or 
on diagnosing or analyzing the problem appropriately The - 
idea in designing the test is to replicate some *&f the critical 
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elements ofr the work setting while cuntrolfing the risk 
tactorfor the apprentice, the employer and the consumer 

The situation form of simulation is like the work-siting 
simulation except that instead of uvng equipment on a 
work sample, the apprentice mereK applies the skills or 
knowledges to a described situation The situation can be 
presented as a role play, as practice or as written description 

\ In each instance, you as an instructor present the apprentice 
with a life-like situation! s) in which he or she must manipu- 
late job-related skills and knowledges to solve a work 
problem or perform a work task ' * x 

hxample* of simulation type tests include written tests 
that require the ap'prentice to imagine himself hersejf as a 
journeyman in a work setting and to respond appropriately 
to a series. of situations For example, a petro chemical 
maintenance apprentice could be presented with a scenario 
in which an electronic recording or regulating instrument 
fails The apprentice could be asked to describe, one step at 

t a time and in order, how he or she would diagnose the 
equipment problem In addition, once the problem was 
diagnosed, the apprentice could be asked how to correct 
the difficulty. The apprentice could be required to describe 
the evidence that he or she would accept as confirmation of 
certain difficulties causing the problems and the evidence 
that he or she would require to believe that the problem 
was corrected. 



Knowledge . » * 

The knowledge type of performance achievement test 
has two forms identification and recall The identification 
type of test involves providing the apprentice with back 
ground information either as a cjuestion or in a situation 
and^ requir es the appre ntice to identify the procedure or , 
tooTnecessaiy to deal with the situation If the test requires 
identification of tools or tool paits, you ahould require alsor 
that the specific function of the topi or part be noted. ^ 

The traditional tests given in most educational settings 
are the recall type test These paper and penci) tests require 
learners to recognize, recall and distinguish between the 
knowledge learned in a -unit of instruction, in order to 
answer specific questions about thai content. This type of 
te$t is useful in related instruction //there, is prerequisite 
knowledge about content that is critical and yet is neither 
immediately observable in an outcome performance nor 
appropriate for simulation type testing, 

Examples of knowledge type questions include questions 
that require the apprentice to recognize or recall certain 
facts about selected topics For example, sdrnctimes appren- 
tices are asked to recall facts about building codes, safety 
regulations or scientific principles. Identification type tests 
often require apprentices to choose appropriate tools or 
materials For example, a carpentry apprentice might be 



given a set of situations about fastening together various 
materials and be required tb select from drawings or actual 
tnatenals the correct fastening device for each situation In 
this example, you also might ask the apprentice to explain 
why he or she chose each device in each situation 

Testing must uke place at appropriate intervals through 
out the related subjects instructional process To be most 
useful, it should be a standard activity that occurs after 4 
completing a unit of instruction At a minimum, you must 
assess acquired knowledge and skills in time for the peri 
odic renew of each apprentice by the program sponsor 
The decisions you must Take in order to evaluate 
. acquired knowledge and skills include (a) determining 
what kind of test to give, (work sample, simulation or 
knowledge), (b) the type of test you want to use, and 
(c) the content of the specific test item for purposes «f 
related subjects instruction, three types of test items are 
recommended. ^1) multiple choice, (2) short answer and 
(3) checklists. The usefulness of the times for the different 
ty pes of tests varies. Multiple choice and short answer items 
are useful on both types of simulation and knowledge tests 
Checklists ma> be used only with simulation work setting 
and knowledge identification types of tests Checklists can 
not b^ used with knowledge recall or simulation situation 
type tests. 



How To Construct And Use A Test 
To Assess Apprentice Knowledge 
Antf Skill 

Given the necessity of evaluating apprentice learning, 
spend your assessment time as productively as possible 
tJse the following suggested steps to insure a good return 
»^n your time investment. 

Step I: Select Test Type and 1 timing . 

TRcvicw yourPlan for Instruction noting the performance 
objectives for the unit of materials and the suggested times 
for testing, Decide when in the instructional cycle you want 
19 test trainees. As you review the performance objectives 
and content, decide what kind of test you want to use, 
given the descriptions presented in this unit. Remember 
thatsimulation and knowledge tests are useful for related 
instruction. Both types of tests are used in these training 
materials, 

Step 2: Write Test Items 

Review the types of test itenjs that are applicable within 
test types. Consider the relative advantages and limitations ^ 
of each of the three ^suggested item types and determine 
what type of item you will use. Use the information in the 
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following paragraphs on item type in making your decision 
and writing items. Regardless of the type of test and kind of 
test lterq you use," remember the- following guidelines for 
writing good test items: } 

* 1. Avoid using ambiguous^tatemerits in any of the test 
material; ' ^ 

2. Avoid using vocabulary that is difficult or unrelated to 
the desired learning outcome; 

3. Avoid using unclear directions; 

4. Avoid using complicated syntax or sentences, and 

5 Avoid providing unintended clues to the correct or 
best answer. 

Multiple -choice items 

Multiple-choice items offer great flexibility for assessing 
all types of performance outcomes because you as instructor 
control the background information, the alternative answers, 
and the level of performance the apprentice must demon- 
strate to answer the question correctly 

A mukiplechoice item is made up of two parts. The first 
-part is called the stem The stem is written as a question or 
presentation. It provides the backgrbund information for 
'the test item as well as the specification of the type of 
operation the apprentice must use to answer the item 
correctly. The second part of the item is the set of alter- ' 
native answers, one of which is either the correct answer or 
the best answer for the problem presented. The other 
alternative answers are called distractors. In the following 
example, the stem and the alternatives are identified. 

Stem: Which of the following types of non-verbal com- 
munication usually conveys the most information? 

Alternatives-. 
a t voice tone r 
b. eye contact 
c hand gestures 
d. posture 

The major advantages of multiple-choice items are flexi- 
bility and scoring ease. The major disadvantages are the 
amount of time it takes to write good questions and the fact 
that, occasionally, the correct or best answer will be 
guessed by an apprentice who did not know the answer. 
^fffic rules you should follow when wyting multiple-choice v 
The rules you should follow when writing multiple-choice 
items will simplify item construction and decrease the likeli- 
hood of an apprentice ccyrectly guessing the answers. The 
rules are' as follows: ~ - 

1. Design each item to measure an important learning 
outcome. Ignore unimportant or irrelevant informa 
tion. Use the behavioral objectives to determine the 
content areas of the items. 



2 Present only one cleanly formulated problem or 
, question in the stem. Explain exactly what is being 

asked and incfude necessary information to answer t 
the question. Avoid unnecessary information. The 
v stem shoufS be understopd without looking at the 
alternatives. 

Example:*' 6 

PoQrstem: While evqryone processes information 
mentally N at a different rate, what is the average 
number of words per .minute most people cap 
process? . ^ 

Better stem: About how many words per minute 
can the average person's mind process? 

3 Construct four (4) on five (5) alternative answers for 
each stem. Be sure that only one alternative is correct 
or represents the best possible answer. 

4. When possible avoid negatively; stated items, either 
in stems or alternatives. If negative construction is 
used, ernphasize the negative construction by under- 
lining or capitalization. 

Example: 

Poor construction. Which of the following be 
haviors is not a bad listening habit 5 

Better construction Which of the following be- 
haviors Is not a bad listening habit? 

5. Write each alternative so that it is grammatically 
consistent with the item's stem. Also, try to make 
e£ch alternative approximately the samejength as all 

- other alternatives. , 
Example: 

Poor construe tion/ When offering feedback to a 
speaker after receiving a communication? you 
should: 

a. -describe wliat you saw and think you heard 
so you d^al whh the facts 

b. focus on behaviof and individual personality 

c. focus on judgement* and evaluation 

w ^Better construction. When offering feedback to a 
^ speaker .after receiving a comniurligujgfT, you 
should: 

4 a. focus on description aojj observation 

b. focus on behavior an<£^)dividual p£?sbnality 

c. focus on judgement and evaluation 

6. Randomly use each alternative postition for correct- 
answers in approximately equ^ numbers. Too fire 
quently test makers avoid th^|ir$and*last positions 
while*- concentrating on the fiddle position. This 
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means use approximately equal amounts of options 
a, b, c, and d or 1, 2, 3, and 4 for the correct answer 
among the alternatives. 

Develop each item so that either it is independent of 
other items or so that all itemsihat depend uponjhe 

• same background information are identified clearly 
in the directions. 

8. Unless important, avoid using choices of "all of the 
above" and/'one of the above" since both contribute 
to guessing or can be used as clues. 

9 Make all alfcrnative answers plausible and avoid clues 
that may permit elimination of incorrect answers or 
guessing of the correct answer. Exercise care so that 
you avoicK a) using key words in the stem arid alter- 
natives . (b) stating the best dr correct answer in 
formal or textbooklike language; (c) stating the best 
or correct answer in greater detail; and (d) using 
two responses with the same meaning. 

10. Improve alternatives by (a) stating each in the lan* 
' guageofthe learner; (b) using common misconcep- 
tions or errors; and (c) making each alternative simi- 
lar in wording, length, emphasis and kind. 

You may use multiple-choice items for both simulation 
and knowledge-type tests. They can be, written to assess 
both knowledge^ subjects and application of information 
to realistic situations Each of the examples displayed in 
Figure 2 demonstrates use of a multiple*choice question to 
assess a skill or knowledge on a different type of related 
subjects Instruction test. Note that sotJ^'items are simply 
knowledgejrecall while other items reqwrejhe learner to 
applv inflation to answer the question ccfpVctly. 



4 



Short-answer iteni£ , 4 

^. ? 
Short-answer items can be used for the same purposes as 

multiple-choice items. They are somewhat easier to con- 
struct, but more difficult to score because^ partially correct 
answers, penmanship and obtuse responses. However, they 
* are aAiseful as multiple-choice items. Teste frequently will 
include items of each type. * 

The item-writing rules for short-answer questions fnclude 
the following: 

1. Construct items so that the required response is con- 
cise, brief and clear 
, ' 2. In general, use a direct question rather than using an 
* \ incomplete statement to ask the question. 
Example: 

P6or contffftctjom The formula for finding the 
surface '£r^*G0 rectanglfcjS • 

Better construction: What is the formula founding 
^thp surface area of a rectangle? *, " 



Figure 2: Examples of 
^Multiple-Choice Questions 

Type of Test 

Knowledge -Recall * 1. A fulcrum is a(n) 

a. lifting machine 
' * b. pivot point on a lever 

c. unit of acceleration 

d. inclined plane 

Knowledge -Identification 2. The tool illustrated is a: 

a. hacksaw , 

b. compass saw 

c. bandsaw 

d. ripsaw 

Simulation- Situation * Using the following 

drawing solve each 
problem below. Show 
all work on back of 
sheet. 



^4**" vT — ^ 




* 

3. The total surface area 
above'ground of the 
figure in square feet is 
approximately: 

Jp5|f square feet °l * 

b. 642 square feet 

c. 722 squarg&et" 

d. 672 squa^Ket 

4. The total volume of the * 
figure in cubic feet is 
approximately: 

a. 1,440 cubic feet 

b. 1,920 cubic feet . - 

c. 1,680 cubic feet 

d. 2,l60cubic feet 



Correct answers;. 1. b; 2. a; 3. d; 4. a. 
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Answer. 



3 limit th ? length of space for answers by setting word 
numbe limits Also make all blanks of equal length 

4 , Reldte^uestions dearly to prescribed learning out- 

comes. J ' N 
• 5. Prescribe !the length of time that is available for con- 
structs g the answer and do not permit a choice of 
questions, 

Coring stofrt^answer tests is both mure time consuming 
and more difficult than scoring multiple-choice questions. , 
To simplify this, task, construct a model answer to use as a 
guide before giving the test. Be sure to consider how you 
will grade answers that are "close" or partially correct. 

As you grade the papers, mark the same answer on each 
apprentice's paper rather than marking all answers on- any 
ofte paper at onciime This will insure more consistency in 
gradipf> each question for all apprentices The techniques 
also will help you to keep grading time to a minumum and 
to insure that you treat all apprentices equally. 

Checklists 

Checklists are useful for evaluating work setting Simula , 
lions and work samples. Focused specifically on procedures 
rather than products, checklists direct an observer s atten 
lion to critical aspects of performance suc^ 1 necessary 
skills and knowledges. They offer the observer a yes, no 
alternative for deciding whether- the specified aspect of 
performance in question was displayed. The observer notes 
the occurrence of the desired "performance at the appropn 
ate spot on the checklist as the apprentice works. You score 
a checklist by summing the number ofchecksand compar 
ing the sum, as well as the specific items checked, against 
the performance criteria. 

The limitations of the checklist include. (1) it, fails to 
indicate how well or thoroughly the aspect of performance 
was enacted; (2) it is subject to the individual judgement of 
each observer; and (3) it is limited to skills and knowledges 
tharhavc observable characteristics. 



c. Arrange items and information on a page so that they 
a/e readable, orderly and-uncluttered. 

d. If it is a paper and pencil test,- position every test item 
on the page so that all information pertaining to that- item is 
on that same page. Also provide a specmt-mra standard way 
to respond as well as a place for test answers. ■ ^ 

e. . Write comprehensive test directions that- explain the 
test purpose, the time allowed to complete the test, and 
how to record the answers. 

f. Reproduce the test and use with the apprentices in 
your charge. 4^ 



Example \ 

4 A. W. Belfour, a related subjects instructor for plumbing 
apprentices, was responsible for the first year of related 
instruction in a four-year program. Apprentices in the pro- 
gram were reviewed every six months so his testing had to 
provide results to the sponsor at least' that often. As he 
reviewed his plan for instruction, including performance 
objectives and proposed course content, he decided that 
the best testing schedule would place a tes^ at the end of 
each content unit. This meailt about one test every six 
weeks. The content units were topics such as cutting struc 
tural openings, characteristics of different types of materials 
and so forth. Using the steps suggested in this chapter, he 
decided to use simulation situation type tests where pos 
sible. Also, he decided to use a series of shon answer and 
multiple choice type test items. As he surveyed the materials 
on measuring, cutting and assembling pipe, he developed 
test items like" those displayed in Figure 3 Note that he 
followed the steps listed in the unit as well as the rules for 
writing multiple choice and short answer items. Belfour 
reported the results to the sponsor at the conclusion of 
each unit of material. He was confident that he had assessed^ 
both knowledge and application. , 



Step 3- Construct the Test 

* , Use the following guidelines to put your items into a 
test; h t* ' * 

* a. Number serially and\£Qnsecutivcly every test item in 
order that you can track trainee progress. Thisalsq will help 
you score the test and discuss results wirtv individual 
apprentices. 

b. Identify individually each response alternative within 
^dh^srftem that offers alternatives. Each alternative must 
htave its own letter (a, b, c) or number (1,2; 3). Usually 
letters are preferred since items are numbered. 
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Figure 3: Portion of 
A. W. Belfour's test 



4. Circle the item on the following list that is not a proper 
use of cast iron pipe: 

r t 

a Steam fittings 

b high pressure fittings 

c. soil' pipes and fittings 

d. gas cock bodies 

5. The local community college is replumbing one of the 
chemistry labs. Whil^most of the lab is a general purpose 
area, two desks and supply tables are used for experi- 
ments that require distilled water from a supply source. 
What kinds of piping would be suitable for plumbing this 
area given what you^now about the characteristics of dif- 
ferent types of pipe? 



Additional Information 

For additional information on developing and using tests 
of knowledge and skills, you may refer to the following 
books. - _ 

R. L. Ebel. Essentials of Educational Measurement, Third 
Edition. Englewood Cliffs, NJ: Prentice-Hall,"Inc, 1965. 

N. E Gronland. Constructing Achievement Tests. Englewood 
Cliffs, NJ: Prentice-Hall, Inc., 1968 , 

W. J. Popham (Ed.) Criterion-Referenced Measurement 
Englewood Cliffs, NJ: Educational Technology Publica- 
tions, 1971. 



Answer 



6. Given two 90 * eJls, how long must you cut a piece of 1 * 
pipe to give yduVcc, measurement of 22 inches with 
both ells attached? 



Answer: 



Answers: 
*.b . 

5. glass, tin 

6. Cut the pipe 20" long, thread and screen on both 

ells. A c.c. will be 22 inches. - 
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Self-Test Exercises 



Ark>u*r the following question* and compare yoicr answers with those provided in the appendix j>J this booklet 

I After leading each uf the following scenarios involving a related subjects instructor, decide what t>pe of test was 
employed in each situation ' t s .*! . 

A. A related subjects instructor in glazing decided to assess apprentice understanding of types of sealants He 
described ten different situations in which a sealant was to be used and asked each apprentice to identify the most 
appropriate sealant, given the circumstances. This was an example^" a what type of test? 
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Answer 



B Lach machinist apprentice was required to answer correctly 80% of twenty equations that required solving for an 

unknown This was an example of what type of test? Answer. — — 

A meat cutting apprentice was required to identify by name six majorcuts of beef from a forequarter This was an 
example of what type of test? 



Answer 



2 . Read each of the fulluwing twu test items and note the problems.with the item in the blanks provided after each item. 
A In our course on print ipg composition processes, four types- of indentation were taught. They were straight 
matter, poetry, and : — 

Problems Noted. 



B Which of the following items is not a safety rule for using a hammer properly: 
1 Don't stnkejcvcxxi or plastic handled chisels. 
2, Don't pound with cheek of hammer. 
5, Don't pound sharp objects with mallets; 
4 Always tap object lightly before hard strike to set eye on target. 
Problems Noted: 



s 
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3. Skill: Assess Apprentice Work-Related 
Attitudes And Values c 



Introduction And Objectives 

Have you ever known a worker who got fired because 
his or her behavior— not his or her craft skills— did not 
match the behavior expected by the foreman, supervisor or 
owper? Somehow the worker did not learn, or did not 
follow,* expected behavior patterns for employees Ah 
apprenticeship program with a comphehensive related 
instruction component might have helped that fired worker, 
'Related instruction not only provides apprentices with 
technical Information associated with job skills, "but also is 
an opportunity to teach and reinforce appropriate work 
attitudes anjd values Such attitudes and values are irriportant 
because fhey directly affect employee success and satis- 
faction on the job Perhaps more important, work attitudes 
and values also affect two increasingly important concerns 
in today's workplace .productivity and product quality 
Characteristics like pride in work, adherence to rules, 
following directions, punctuality and other work attitudes 
and nraits are hallmarks of successful employees They* 
influence work that results in reliable products and in- 
creased efficiency. 

This chapter is about assessing work-related attitudes and 
includes directions for constructing and using instruments 
to evaluate apprentice work attitudes and values After you 
have completed work in this unit, you will demonstrate 
your competence in assessing attitudes by being able to- 

1. Identify and list the work-related attitudes required 
by an apprentice in order to function with approval in 
the workplace. 

2. Design and construct an Instrument for assessing and 
recording work attitudes. 



What, Why And When Use The Skill 



Work related attitudes and values are an important part 
of every job or training setting. Frequently the emphasis is 
implied. However, in some settings, particularly if an 
employee does not conform to behavioral norms, appro- 
priate attitudes are, clearly defined. In this chapter, it is 
assumed that work attitudes will be defined within related 
studies. 

Employees must know and follow the behavior rules for 
a job. For example, if working with fellow employees is 



critical to the job, then workers must conform to certain 
rules for interaction. If interaction with the public is impor- 
tant,jjaen certain rules for dre£s, manner and discourse 
must be followed on the job. In each instance, these rules 
could be addressed in related instruction as a specific course 
content. In fact, you should include the ideas in your per- 
formance objectives, design your evaluation instruments 
around the attitudes, and include the information as part of 
the data you provide to the program sponsor. 

Assessing work-related attitudes and values is different 
from the typical testing in related subjects instruction be- 
cause usually there is no single conect answer for any 
question or item. Instead, the real issifes are to determine 
(a) what attitudes are important and (b) where or how 
set the cutpoint that divides gpod and poor attitudes on any 
particular topic. ... • 

Several types of assessment instruments are used to 
quantify and describe attitudes. These include tests; eating 
scales and arfecdotal records. The latter two types pf assess- 
ment are recommend^jUor related subjects instructional 
settings. A typical test is not recommended because it is a 
self-reporting document, and arfapprentice coflld tell you 
anything he or she wanted to tell you. 

There are several cautions to remember in constructing 
attitude instruments. First, you must have several examples 
of behavior. Assessment of work-related attitudes ideally 
should.occur either continually or periodicallyihroughout 
the period of related training. You must observe apprentice 
behavior in a number of situations and .settings since atti- 
tude assessment implies that present behavior is a good 
indicator of future behavior on the job Second, however 
and whenever assessment of apprentice attitudes takes 
place, always remember that you must treat the results con- 
fidentially. Third, you must respect individual rights and 
dignity in performing the assessment and you must treat 
'e^ch apprentice impartially. Fourth, realize that you are 
making educated guesses about apprentice attitudes. You 
can never really know for sure, so allow for the possibility 
that your judgement is fncorrect. 

How To Construct An Instrument For 
Assessing Work Attitudes 

Follow the suggested steps for constructing assessment 
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instrument^ to asess in order to save time and improve your 
assessment capabilities. 

Step I Make a List of Attitudes and Values 

Consider trades and crafts for which the members of 
your related instruction class are training. List each work- 
related attitude, characteristic or trait that is important to 
each of those jobs on a sheet of paper. On the same sheet, 
beside each listed trait, note briefly why the attitude or trait 
is important — specifically how does it influence perform 
ance^ In trying to identify attitudes and traits it is usually 
helpful to consider factors such as social and organizational 
contexts of work, procedure and product performance 
specifications, and employee discretion Also consider the 
responsibility, authority and decisions each apprentice 
must make 



Step 2: List Behaviors Indicating Good Attitudes 

After listing each attitude or trait f consider the set of 
performances by a worker that demonstrate that the worker 
has a positive orientation toward each attitude. In addition, 
imagine a set of performances in which the worker demon- 
strates a negative orientation toward the attitude in question. 
Note the elements of the positive orientation on the appro- 
priate line next to the characteristic. 



Rating scales 

Rating scales are instruments that permit an observer to 
focus on specific critical aspects of job performance and to 
assign that performance a numeric value on a scale. When 
> using rating scales make observations at regular, prescribed* 
intervals. Score the scale by averaging the rating on similar 
items or categories of items. The general rules to follow in 
constructing and using a rating scale are the following- 

1. Include on the scale each item or element to be rated 
as a separate rule, together witrrthe rating scale and 
the directions for use. 

2. Rate each item or attribute one element at a time and 
mark the judgement in the correct spot. 

3- Rate each item according to an initial judgement and 
do not change the rating at a later time. 

4. Rate each item in accord with prespecified perform- 
ance criteria. Avoid extreme ratings and avoid the. 
influence of past performance and extraneous influ 
ences. 

5. Use consensus or multiple ratings when possible. 

Figure 4 illustrates a typical work attitude rating scale The 
sample scale is designed for use with 'individual appren 
tices. It has a uniform date of observation, includes a series 
of items covering many work attitudes, and is scored by 
circling a number that represents the value of the perfor 
mance observed. 



Step 3: Rank Attitudes 

Rank the work attitudes, characteristics "and traits accord- 
ing to their importance in the trades for which the appren- 
tices in your class are training. Enter the ranlf beside each 
item 



Step 4: Incorporate Attitude Objectives in Your Instruc- 
tional Plan 

Develop several performance objectives that express the 
expectation that apprentices will master and display the 
most important work attitudes or characteristics. Include 
these in the course description and instructional plan. It 
may be appropriate to expect different levels of attitudes 
for apprentices in different years of training. 



Step 5: Construct and Use Assessment Instruments 

Taking the attitudes or charaetenstics judged to be most 
important by vour rankings, decide what instruments you 
need to assess attitudes. Once you have decided how you 
wlmt to assess attitudes, construct and use the instruments 
tu assess work related attitudes. The following descriptions 
of rating scales and anecdotal records will help you do this. 



Anecdotal records 

Anecdotal records are a second type of instrument for 
assessing work-related attitudes. Anecdotal records require 
observation, but are not as fofmal as rating scales. Instead, 
use them to note behavior as you work each day with the 
apprentices in your charge. They. are most usetJlT if the 
instructor looks for critical incidents or behavior ttyat can be 
associated with attitudes. The behaviors or attitudes shou!^ 
be specifi&l in the expectatiyns or course objectives that 
you prepare and explain in advance of instruction. 

Figure 5 is a sample anecdotal record that you can use 
to chart apprentice behavior. The chart in the figure is 
focused on work attitudes. It provides a record for you 
to use when talking with individual apprentices and when 
.making recommendations to the program sponsor. The 
example in this illustration focuses on incidents wheMhe 
apprentice displays inappropriate behavior.^All behavior 
not noted is assumed to be appropriate. You can design the 
record to note either positive or negative critical incidents. 
Negative incidents ard easier to rroticeand record, but are 
not as beneficial to the apprentice. Positive inddepts tend 
to reinforce positive behavior. 
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Figure 4: Work Attitude Rating Scale , ' 

Apprentice Name* '. 

Date of Observation I < 

The above named apprentice demonstrated the level of performance indicated below on the listed work auiiude attributes 
durmg this related subjects term. , * 



Level of Performance 

Areas of Concern „ low High 



1 Demonstrates punctuality by being on time and rarely absent 1 


2 \ 


,3 


"a 


5 


- 2 Shows considerable interest in working in the trade 1 


2 


3 


4 


5 


3 Approaches work irt a resourceful manner 1 


2 , 


3 


4 ■ 


5 


4 Completes an appropriate amount of work ' 1 


2 * 


3 


4 


5 


5 Finishes products that meet or exceed industry-accepted standards , 1 


2 


3 


4 


5 


6. Uses tact in expressing self and interacting with others 1 


2 


3 


4 


5 


7. follows directions, instructions and prescribed procedures " 1 


V 


3 


4 


5 


8. Accepts and uses suggestions of and instruction from the supervisor P 1 


2 


3 


4 


5 


9. Does no^ interfere with work being dohe by others'* 1 


2 


3 


4 


5 


10. Works cooperatively with others 1 


0 
L 


D 


4 


J 


11. Exercises care'in handling and use of tools, equipment, and materials ^\ 


2 


3 


4 


5 


12. Follows industry-accepted safety rules 1 > 


2 


3 


4 


~5 


13- Seems to enjoy work and working' 1 


2 


3 


4 


5 


14. Demonstrates pride in working performed 1 


2 


3 


4 


5 


15. Exhibits appropriate industry-rejate^ grooming, dress and hygiene practices 1 

1 6. Works steadily with few breaks " 1 1 


2 


3 


• 4 


5 


2 


3 


4 


. 5 


17. Does what he/she say they will do 1 


2 


3 


4 


5 


18. Seeks ^improve job performance • 1 


2 


3 


4 


5 


19. Has'a positiv^balanced outlook about life.in general ' 1 


2 ' 


3 


4 


5 • 


20. Can be counted on to fulfill work responsibilities 1 


2 


3 


4 


5 


; y * — ! 

.* Number of attributes scored-high low 










* Areas needing continued work 








/ 


• Overall recommendation 


* 
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Figure 5: Anecdotal Record of Apprentice Work Attitude 



Name 



Time Period Term: 



The abo\e named apprentice i* considered to exhibit appropriate tradesworker responses to the work attitudes listed below 
unless otherwise noted 



Date of Problem 



Item 



Comments 



I. Dependability 

a At assigned work station or in class^ 
wfthin 3 minutes of expected time 
b Responds truthfully 

c Stays on the job without excessive breaks 

k d Completes tasks in required time 

e Does what he/she say they will do 

f Follows directions, instructions and 
prescribed procedures 

8 . 



1 r 



II. Acceptance of Supervision 

a Accepts and uses supervisors' suggestions 

b Pays attention to directions and * 

demonstrations 
c Discusses instructions but does not argue 

d. 



& 



t~ r 



III. Personal Standards 

a Maintains appropriate and acceptable 
personal grooming practices ' 

b Maintains appropriate and 1 acceptable 
personal hygiene standards 

c. Indicates positive outlook about future 

d. Demonstrates a desire to work 



10 



k 



9 
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IV. Working With Others 

a Does not interfere or hinder work of 
others 

b. Treats coworkers cprdially 

c. Helps others when requested to do so by 
supervisor 

d. Interacts appropriately with co-workers 
e. 



V. Performance Quality 

a. Exercises.appropriate safety precautions 
at work and learning stations 

b. Performs consistent with demonstrated 
levels of ability and skill 

c Shows interest and enthusiasm for job 
and trade 

d. Demonstrates initiative, resourcefulness and 
aggressiveness 

e. Works steadily and at an 
appropriate speed 

f Checks work for accuracy and quality 

g. Produces an acceptable amount of work 

h. Organizes work, materials and tools prior 
to undertaking task 

r. Does not abuse or misuse tools, 

equipment arid materials 
j. Recovers quickly firdm setback or 

adversity 
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Example 

Frederick Dail\ was a related subjects instructor in an 
apprenticeship program fur the Automotive Servue Council 
He knew that the apprentices, when they became journey 
men, would ]be required to work harmoniously with other 
workers as well as to interact with the public. Interacting 
with the public was viewed as particularly critical because 
of increasing costsNaf auto repair and newspaper reports 
about some mechanics— not associated with the Council— 
who had done shoddy work. Therefore, work-related atti- 
tudes such as honesty were perceived to be of utmost 
importance. Daily, therefore, incorporated attitude instruo 
tion and assessment into his related subjects course. As he 
analyzed the jobs for which the apprentices in his charge" 
were training, he decided that three categories of work- 
related attitudes were important (a) customer relations 
attributes, ( b) honesty; and (c) pride in work. As he visuali- 
zed the performances of workers that would demonstrate 
positive and negative behaviors of these attributes, he gen- 
erated the following list of critical performances: 

1. Uses tact expressing self and working with others; . 
2 Kxhibits industry' accepted personal grooming, dress 

and hygiene practices; 
3. Does what he/she says they will do; 

4 Works steadily with few breaks; 

5 Completes work that meets or exceeds standards of 
quality, 

6. Demonstrates pride in work performed;- and 
7 Appears to enjoy work and working 

Daily decided that he would develop a rating scale to 
note the behavior of each apprentice on each item. Further, 
he decided that he would rate apprentices monthly on 
each of these characteristics. He would then develop \ 
summary rating at the end of the related studies period. He 
decided to use a four-point rating scale to assign a value to 
apprentice behavior about each item. Figure 6 shows the 
* rating scale for one of Daily's students. 



Self-Test Exercises 

Answer the question* belou in the space provided or on 
uvrk paper. Compare your answers with those protided in 
the appendix of the booklet. 

1. List as many of the work-related attitudes as you can 
for the jobs for which apprentices in your charge are 
training. 



List the advantages to your using a rating, scale as 
opposed to using an anecdotal record. 



3. Design an anecdotal record for use with the appren 
' tices in your charge. What elements are included on 
^ , the record? 



Additional Information 

For more information about assessing attitudes and values, 
refer to the following: 

J. A. Green. Introduction to Measurement and Evaluation 

New York: Dodd,.Mead and Co., 1970. 
J. P. Robinson, R. Athanasion, and K. B. Head. Measures of 

Occupational Attitudes and Occupational Characteristics 

Ann Arbor, MI: ISR of the University of Michigan, 1974. 
T. D. Jen Brink, Evaluation: A Practical Guide for Teachers 

New York: McGraw-Hill Book Co., 1974. 
H. C. Triandis. Attitudes and Attitude Change New York: 

John Wiley and Sons., Inc., 1971. * 
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Figure 6: Work Attitudes 



Attitudes 



1. Uses tact in expressing self and working 
with others 

2. Exhibits industry-accepted personal 
grooming, dress and hygiene practices 

3 Does what he/sh* says they will do 



4. Works steadily with few breaks 

5. Completes work that meets or exceeds 
standards of quality 

6. Demonstrates pride in work performed 

7. Appears to orjjoy work and working 



Ratings 



A = Excellent 
3 = Good 



October 



2 © 4 

(D 3 4 

2 © 4' 

2 © 4 

2 © 4 

2 3; © 

2 3 © 



2 = Fair/Questionable 
1 = Poor 



November 



2 © 4 

© 3 4 

2 3 © 

2 © 4 S 

2 3 © 

2 3 © 

2 3 -® 



December 



2 © 4 

2 (§) 4 

2 3 © 

2 © 4 

2 © 4 

2 3 © 

2 '3 © 



Term 
Composite 



3.0 
.3-7 



Apprentice Name 



V 



00 



4. Skill: Discuss Individual Evaluation Results 
With Apprentice Learners 



Introduction And Objectives 

Evaluation consumes a substantial amount of teacher and 
instructional time. To ensure that the investment* of time 
and effort pays an adequate return, you must -consider the 
uses of test results as you construct the instrument. 

Test or evaluation results should be used for three-major 
purposes (a) feedback to apprentices, (b) feedback to the 
instructor, and (c) certification and permanent record of 
results Each use requires that you as. a related instructor 
employ different skills This chapter is ^>out providing feed- 
back to apprentices by discussing individual evaluation 
results with trainees. When you have completed your work 
in this section of materials you will demonstrate your com- 
petence in this skill by being able to: 

1 List and disc uss in writing the majur functions of using 
indiudual e\aluatiun results with apprentice learners. 

2 Outline a technique fur proudihg feedback systemati 
cally to apprentices in your class. 

As you work through the following materials you should 
think about how test results currently are conveyed to 
apprentices in the program. Does the following information 
suggest uses of results that you dp not practice routinely in 
your class* 



What And Why Should You Discuss 
* ' Test Results 

A major purpose of evaluating learning is to provide 
feedback to apprentices about their success in-, learning 
subject matter and skills In that capacity, testing provides 
information that stimulates and clarifies the learning task, 
serves as a Study aid, provides a reward and produces appro- 
priate work attitudes. Each function benefits the apprentice 
and the employer. 

Stimulates And Clarifies The Learning 
Task 

Discussing the results of performance testing clarifies the 
learning task. It directs apprentice attention to certain topic 
areas, emphasizes certain content, focuses on certain types 



of learning and encourages the use of short-term goals. 
Take, for example, a segment of a related subjects course in 
graphic arts where the principles of color were being dis- 
cussed. The discussion of evaluation results using prespeci- 
fied objectives established the, outcome expectations -for 
each past and future section of materials for the apprentice. 
Objectives included outcomes such as naming primary 
colors, describing the interaction of various ink colors and 
grades of paper and matching appropriate color pf paper 
and ink for various types of printing jobs. The objectives 
and the evaluation exercises'based on these objectives indi- 
cated precisely what performances and levels of proficiency 
were expected of the apprentice after instruction. This, in 
turn, suggested the specific content that was to be mastered. 
It also provided a specific, short-term time period and goal 
in which to learn the material. Further, when the format 
was followed consistently, apprentices learned to focus 
efforts on ideas presented in r objectives.and verified through 
the discussion of evaluation. „ 

/ Service as a Study Aid 

Discussing test results serves as a study aid for the learn 
ing task by demonstrating the relationship between related 
studies and job task performances. The oppertuniry to 
practice knowledge application in jk»#1 or simulated situa- 
tions is available to the appr^nti^e attempting,to master 
related materials. Further, su<fh r £tectrce,,even if performed 
in written or simulation situation^&fferi an opportunity to 
transfer skills and knowledges from one*situatiOn to another. 
This reinforces retention of content. 



Provides A Reward * * 

Discussing test results also serves as a reward fQr learning. 
If the testing is an effective performance achievement test, 
apprentices clearly earn their test scare by their own efforts. 
Acknowledgements of mastery demonstrate a positive return 
for an investment .of apprentice time as well as provide a 
visual public and private record of performance. Further, 
acknowledgement of mastecy as a reward makes learning 
more efficient because most learners come to valtie the 
reward as an incentive. . 



A 



Produces Appropriate Work Attitudes 

A final critical outcome of discussing test results, with in- 
dividual apprentices is assisting each apprentice to develop 
appropnate 'work attitudes. Use of test results as pan of the 
instructional process helps to instill the notion of the appro- 
pnatenessrofwork (process and product) assessment on 
the job by supervisors and foremen. Accepting and using 
the results of work evaluation on the job is an important 
learned behavior. It is important not only to work, but also 
to job retention and advancement. It reinforces the ideas of 
quality control, merit advances, taking directions and the 
legitimacy of external evaluation. . . 

When And How To Discuss 
Test Results 

Any of these functions uf discussing evaluation results 
requires a structure and furum for presenting and using the 
information. Testing results can be discussed effectively 
with an entire related studies class', if it is done so no 
individuals are identified and if the class is working at the 
same .general rate of progress on the same topic. A more 
preferrable procedure is individual conferences conducted 
at regular intervals throughout the related subjects instruc 
tional period. 

Individual conferences provide you with opportunities 
to get to know each apprentice on a more personal basis 
They also offer you an opportunity to enter the results of 
the test on the permanent record and obtain the appren- 
tice's signature on the record in recognition of the grade, 
score or mark. 

Individual conferences should be held on a regular basis] 
perhaps as often as every month. The discussion time can 
be used to clarify performance expectations, to assist the 
apprentice in structuring time, to "discuss problems and 
concerns, and to bring closure to various segments of 
related instruction. 

When holding the conferences, establish a general agenda 
of topics and time to follow with each apprentice The 
agenda can be modified with individual, personalized con- 
cerns as needed. When such conferences are used to discuss 
upcoming content, to talk about performance, or to solve 
personal work related problems, they have been demon- 
strated to improve adult learning. 

Your conferences will be most useful if you follow a 
series of precedural guidelines for conducting the activity 

Step 1; Develop an Agenda » 

Establish and follow an agenda for eacrnconference. The 
agenda generally can be identical for each apprentice The 
agenda should be written; should indicate the time; date 



Discuss Evaluation 'Results : 19 

-~and name of each apprentice, should list each topic to be 
' addressed; and should include a space for noting the dis- 
cussion and/or resolution regarding each topic. " 

Step 2: Develop a Schedule 

' Schedule a time for all conferences and post It in a public 
place at least one week before initiation of the first confer- 
ence. The schedule should note the name, date, location 
and time for the conference with each apprentice. Also, the 
schedule should list the general topics of concern and in- 
dicate any prior preparation of materials that apprentices 
* are expected to bring with them to the conference session. 

. Step 3: Prepare For Each Conference 

Review information such as grades, progress, attendence 
and results of past conferences on each individual appren- 
tice before the time for the conference. Make notes in the 
margin uf individuals agenda about particular points or 
concerns you want to raise during the conference , 

Step 4; Conduct the Conferences 

In conducting the conference, use the time efficiently 
and effectively. Start on time, move crisply from topic 40 
topic, and address any subject of concern to either you or 
the apprentice. Effective conferences can be as short, as 10 
minutes or as long as 30 minutes. 

Establish a conference atmosphere that is comfortable 
yet work-like, you should assume the role of a foreman or 
supervisor 'and the apprentice that of a worker in your 
charge. In those roles, you will serve both as advocate for 
and evaluator of apprentice worl|You want the apprentice 
to succeed and to perform wellfffch because it represents 
growth for the apprentice and Be cause it reflects well on 
you. Your discussion must be frank and open, without 
reprisals and without carrying over into the classroom. You 
should offer evidence and examples to'support the Qomts 
or conclusions you make during the conversation. Equally 
in^ortant, you must listen to the cpneerns and points 
offered by the apprentice. Remember that the tone you set 
in the conference maybe a m a j jg ftf tor affecting appren- 
tice productivity in the classroom and on the job. 
. As you move through the agenda, one ftoint at a time, 
enter notes and resolutions about each topic at an appro- 
priate place on the written agenda. When possible, have the 
apprentices establish short-term training goals for agenda 
topics for themselves. Commit these goals to the written 
record. At the conclusion of the conference, both you and 
the apprentice* should initial the written record of the 
agenda. The record should be filed in the individual 
apprentice's record folder in the file cabinet so that both 
you and the apprentice cgn refer to it through the next 
work period. * » * 



O 4 



Evaluating Apprentice Performance 



v Example 

Issac James was a related subjects mathematics instructor 
rn a large shipyard apprenticeship program The program in 
which James trained apprentices in more than a do/en 
different apprenticeable occupations including electrician, 
welder, shipfitter, pipefitter and sheetmetal worker James' 
geometry and algebra related subjects classes usually in- 
cluded apprentices from four or five different occupations. 
Further* his Classes were usually large and the apprentices 
possessed a wide variety of backgrounds and skills. 

One result of the diversity was James had noticed that 
every' time he taught the class some apprentices usually had 
trouble completing the mathematics requirements success- 
fully Additionally, they often seemed frustrated with their 
grades Further, grades held different values for different 
trainees 

James decided to use the technique of individual confer- 
ences to discuss grades and to set content goals for each 
apprentice during the mathematics classes he taught He 
decided that even though each of his classes was only six 
weeks in length, he could schedule ten minute conferences 
every two weeks with each apprentice for both the algebra 
and geometry sections. He followed the steps outlined in 
the unit on discussing test results and begar) the first set of 
conferences after the first test The first agenda he'eonstruct- 
ed is presented in Figure 7 Note that James wrote out the 
agenda and fillecTin the form as the discussion with appreff % 
tice Howard Tilley excurred. He addressed content and 
results ofthe test recently taken; generaj progress in the 
programjupc/mmg topics and contents; and goals for the 
upcoming content and sessions When the conference , was 
completed.'James placed the agenda for each apprentice in 
the work folder for that apprentice. 

James found that after the first two conferences, he could 
set the conferences at three week intervals. After Several 
sessions of conferences James found that both apprentice 
test scores and* repeats of satisfaction with training had 
improved, * ^ 

Additional fnforrnantjon 

For mure information about the use of test results in an 
instructional setting, see the following xeferences: 

J. A. Green. Teacber-Made Tests. New York: Harper and 
Row, 1963, 1975. 

W. P. Gorth, R. P O'Reilly; and P. D. Pinsfcy Comprehensive 
Achievement Monitoring Knglewcxxl Cliffs, N/: Educa- 
tional Technology Publications, 197$. v 



Self-T^st Exercises 



Please answer the following questions in the space pro 
i ided or on separate work paper. Chetkyvur answers by 
referring to the appendix in the ba^k of the booklet 

1 List in one sentence, short-answer formWfc ionr major 
benefits of discussing test results with apprentices. 



Stephen Carlton was related instructor in a sheet- 
metal apprenticeship program. He felt that he was not 
gettingjhe maximum effort frojrr his apprentice 
charges so he decided to initiate individual confer 
ences to discuss test relults and set academic 
( a motivator He followed the first several stepS'Oyt- 
, lined in the materials regarding conferences inducted 
Constyfflcttng an agend^etting up a schedule, review- 
ing past performance and so forth. However, he was 
unclear exactly how to behavdsin interacting with an 
individual apprentic^during a conference. What major 
things would you atfyise^arfion to do In conducting 
the discussiotnfythe cymferenee? list five items. 



* ./ 




ijejjs 



3. Consider your trade and relatecTsubjecfts obligations 
,0 and construct a model agwtia for an* individual 
conference with your apprentices. Check your model 
with thejanswer presented in the Appendix. 
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, FigtflSt 7: Sa mple Individual Conference Agenda 

»■ ■ — ' * — ' ■ ' ' ~ ' " 



Agenda IndividualConfetences Z-,^// 
Apprentice Namer ^nOOlAf^ ±U /fr y 

If Feedback 4 % * ^ 

A/ Test^Srore: I g v > 



B. Areas of strength and Imitations. Sfe&jffjgj I M«lhpl«Jl*- , ftc'Mtkrf 



C Suggestions for aaLonal work" rWtfelrtk l f, 67'?Z , r^Cfi* 

' : — ; — T 

D D.scuss.on notes: 6d** M*L fa/iifK h ^rt'jSrmJ^ WW 



E Resolut,on of issue: j ^fttc toll kf CVKfk&J' / *f J^iL ; 

/,»// OACMlkL ***** ( 



II. General Progress in Program /V . ^ / / • • Z 7 / 
) A. Observation; kf ft phUf l/lfrW A CM 

■ B. Anpren^ice satisfatflfr: J^QqJ', Uo l t U ftU Add* Hi t^A 



^mgh — 

C. DiscussioV - /fo/ft / ^ ^ ^ 



•if 



HI. Upcoming Topics^j^i Contents 

A. Content or Topics: ^ 



. %^ ****** Htort* . ; • y 

Br Applicfcti^h of information for apprenticeship: 2 ^KyP-gJ — , — v f n yyr * 

* ' - 

"•• £s£ : ^ , -- — — 



D. Apprentice^Goals: 
* 1. Make-up test = 



2. Test on next section = 



Attested:. Instructor:. — — - A R£ ! 



re mice: 
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5. Skillr Develop Instrumentation To Certify Skills 
And Knowledges Upon Completion Of 
Program Or Course 



.Introduction And Objectives 

Once you have performed your evaluations, you must 
report the findings about individual performance regarding 
required knowledges and skills to the program sponsor. It 
is critical that you describe precisely what knowledges and 
skills each apprentice possesses and explain how well the 
level of knowledges and skills acquired compares to trade 
s Adards. Further, you must report that information system- 
a^My for each apprentice. This means that you must create 
ana use a consistent record- keeping system for certifying 
and reporting skills and knowledges for all apprentices. 
This chapter is devoted t^providing you^wi^h ideas and 
formats for maintaining^pdardized ifraividuafand group 
knowledge and skill reCorateepingoperations. When you 
have completed your work in this section of materials, you 
will demonstrate your competence in this skill by being 
able to: - 



1 List the critical elements in a systematic certification 
record. 

2 Critique and develop sample instruments useful to 
certify apprentice knowledges and skills 

As you work through this unit of materials, examine the 
instruments and devices you use currently to certify and 
report related subjects knowledges and skills. "Do they in- 
dicate the necessary information? 



Why, When And What Is Record Keeping About 

Yuu are obligated to keep records for both legal reasons 
and for keeping track of apprentice learning activities. The 
most important consideration concerning the legal aspects 
of record keeping and certification of skills is -that thje, 
apprenticeship agreement is a training contract in which 
the requirements of both the apprentice and the apprentice 
trainers are specified You are obligated to provide Instruc 
tion in certain job related topics. Likewise, you are obli 
gated to provide the specified instruction either for a certain 
number of hours or until specified performance outcomes 
are achieved by the apprentice. This means (hat you are 
obligated to keep records of apprentice performance, 



attendance and timein instruction by content. These records 
document apprentice progress and, in most training pro- 
grams, are used by the program sponsor to make decisions 
about advancing the apprentice in grades of pay and respon- 
sibility Your records must be accurate, current and in suf- 



ficient detail for making recommendations and decisions 
about each individual apprentice. 

A second important legal aspect of grading and record 
keeping is that the performance standards for each appren- 
tice in a trade or craft must be reasonably similar. Perform- 
ance outcomes and types of reporting in related subjects 
instruction cannot vary appreciably from apprentice to 
apprentice. Not only are you required to certify to the 
program sponsor that the Apprentice has mastered certain 
necessary skills and knowledges, but also you are expected 
to provide your judgrnent on expected succeess in the 
trade for each apprentice. Make certain that you assess 
apprentices using equal means and report findings in simi- 
lar ways. The equal opportunity is particularly critical given 
that some apprentices simply do not master the necessary 
knowledge and skill^to become certified journeymen and 
some apprentices do not complete their training. 

A final importan^legal aspect of related subjects instruc- 
tion records involves reimbursement. Because funds to 
support the related.instruction activity may come from one 
or mo'r^ of a variety of sources (i.e., union training funds, 
employejuraining budget, state education agency) you must 
be able to certify the contact hours of instruction and the 
hours of facility use for each apprentice. 

Ffe^ords also are important for keeping track of apprentice 
learning activities. A visible progress record for all appren- 
tices is an effective motivational device. Even more impor- 
tant, by keeping composite performance records, over time 
you as a related subjects instructor can make logical teaching 
decisions about how to adjust content, modify criteria, pace 
materials and so forth* for future groups of apprentices in 
. related subjects instruction. For Example, suppose from your 
progress record of related subjects general physical science 
instruction you found that some apprentices had difficulty 
\mastering information on the principles of electrical resist 
ance but had little trouble with the concept of battery 
storage of electrical current. Then you could seek to (a) 
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provide modified information about electrical resistance, 
(b) increase the length of time spent on electrical resistance " 
while decreasing the time spent on battery storage; and (c) 
review and perhaps modify the criteria related to the study 
of electrical resistance Your composite record of apprentice 
progress woyld suggest and justify your decision to alter 
instruction on the two topics. 

Whatever record keeping and reporting system you use, 
it is critical that the records be accurate and up-to-date 
Make your entries as often and as long as necessary in order 5 
to insure that at any time up to four years later, a sponsor 
such as a LJATC making a final appraisal of an apprentice's 
skills and knowledges could determine precisely what the 
record was reporting. 



How To Set Up A Record Keeping 
And Reporting System 

The procedures recommended in setting up a record 
keeping and reporting system are tied to the type of record 
being developed. It is r^ommended that you keep one 
overall record of composite progress and two types of indi 
vidual records, one for knowledges/ skills/ attitudes and one 



for time. The procedures are suggested as steps and des- 
cribed in the following paragraphs. 

Step J. Explore Different Record Systems 

Talk with the program sponsor— LJATC, employer or 
school— to determine if the specific type of record keeping 
and reporting system is prescribed. In addition, consult 
industry standards to determine if suggestions about type 
of record systems are offered. If so, use these ideas in 
conjunction with the ideas offered below. 

Step 2. Develop Ami Use an Overall Performance Record 

Consider the alternative ways for maintaining an overall 
> progress record-of apprentices. Choose one possibility and 
develop and use the instrument Two types of progress 
records are suggested. One is a type of bar graph as dis- 
played in Figure 8. This type of record is a graphic used for 
public display of the general progress of each apprentice. 
Apprentices' names are listed in the left hand column 
Content areas or performance objectives are listed in the 
numbered areas across the top of the figure As each appren- 
tice performs to the level of success for each criteria within 
each objective, a check or line is.extended from the appren 



Figure 8: Progress Record of Apprentices 
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Figure 9, Long-Term Performance For Related Studies 
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tices name through their current end point. The progress 
chart shoufd be on public display and should be up dated 
each week. It will permit yuu as the instructor (as well as 
each apprentice ) to monitor individual progress. 

A second type of progress schedule is more for your 
decision making and is nut necessarily intended for display. 
This type of record is illustrated in Figure 9. As you will 
note, the recurd systematizes cullectiun and sturage of sum 
mary data from apprentices uver a period of time on each 
of the performance objectives ur content areas in related 
subjects instruction. The record requires that you note in 
formation such as the time required by most apprentices to 
learn the materials, the average s£ore bn each criterion for 
groups of apprentices and the average number of items 
answered correctly Such information is useful to you as 
you make future instructional decisions about materials, 
content and criteria. 

Step 3: File Records *. * 

Set aside a space such as a single file drawer or a box as a 
file fjor apprenticesXrecords Provide a folder or envelope 
for each apprentice Put the apprentices' name on it 2nd 
place it in the file. Discuss the file in class so that each^ 
apprentice knows where his or her file is and the rules 
pertaining to its use and access 

Step 4: Develop and use time records 

The majority of apprentice sjsonsors require a given 
number of hours be spent in related subjects instruction 
and on particular topics. For example, an apprentice pro- * 



gram for the American Public Works Association might 
specify at least 144 hours of related instruction per year 
Assume that within that 144 hours during the final year, 15 
hours must be spent on studying communication skills, 10 
hours on law and labor relations and so forth. You as a 
related subjects instructor must keep track of each appren 
tices' time in class and on each topic. Figure 10 is a record 
that facilitates keeping this kind of data. Note that the record 
should be maintained for each apprentice and that the 
record includes data on outcomes, attendance and topics 
.for each month or two of the related subjects experience It 
is often useful to maintain a second copy of the record in 
the apprentice's individual file. 

Step 5: Prepare and maintain individual progress records. 

This record should be updated with each assessment 
activity, should be initialed ,by the apprentice t and the 
instructor (fn an individual conference), and should be 
kept as pan of the individuals^ record. This record should 
be copied arid provided to the program sponsor as the 
formal final reporting for each apprentice for each related 
studies term. A sample record form is illustrated in Figure 
11. Note that the record provides an opportunity to note the 
times of assessment and the date of sucessful performance 
for e^ch criterion for each proposed outcome and peffor-j 
mance objective. Also note that there is a space provided 
for the apprentice to initial the results of each assessment. 
Takefi together with the time record, the progress record 
provides the necessary final/permanent certification to the 
program sponsor. 
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Individual Time Record 



Apprentice's Name: 



Month or Term* 
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Figure 10 



X . 

Example 

An example of the need for and operation of a record 
keeping-system might be found in the training program of 
the local electrical apprentice trailing program. Assume that 
the program was directed by a National Joint Apprenticeship 
and Training Committee. This meant that the content was 
pre*structured and that there was need for standardized 
records. Further, assume that employment demand in the 
industry was high in spite of a sluggish economy. Those 
factors usually meant that competition was keen to become 
an apprentice and to become a licensed journeyman elec 
tncian. The training programs were large, each involving 
several related subjects instructors, thus increasing the 
t^eed for standardized and comprehensive records. Taken 
together, these factors suggested that individual time and 



performance records were a necessity. Time was4cept for 
overall attendance and for time on content, because in the 
national curriculum a given number of hours were pre ' 
scribed for subjects such as aspects of algebra, trigonometry, 
blueprint reading and on the job safety In the performance 
area, national and local standards provided established 

Siteria for successful perfornhance for each content area, 
irther, because of the industry' wide concern for assuring 
quality workmanship, positive work attitudes were being 
emphasized. Related subjects instructors, therefore, found 
it beneficial to maintain individual performance records 
that included content and attitudes as well as an attendance* 
record. The record was filed at th^end of each term with 
the LjAjTC and used as the primary' basis for issuing pay and 
responsibility advancements to apprentices. . 
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Individual Apprentice Progress 



Apprentice's Name: 



Term of Instruction Perioci- 



Performace 
Objective/ Content - 


.Time of 
Assessment 


Date When 
Criterion- 
Level Meet 


Criterion # 1 
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Self-Test Exercises 

-Please answer the following questions in the space pro- 
dded or on separate work paper Check your answers by 
referring to the appendix at the back of the booklet. 

1. List two reasons for maintaining certification records 
in related instruction. 

2. Design an apprentice performance record for your 
class. 
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6. Appendix 



r 



i Answers To Self-Test Exercises 



2. Suggestions for conducting a conference include: . 



2. SKILL As 



sse^Drai\ 



nee Knowledge And Skills 



la, Simulation-situation 
lb. Simulation-situation 
1c. Knowledge-identification 

2a. Blanks give clues to correct answer. 

2b. Use of negative construction; correct answer was 

longer; correct answer was stated as only option in 

positive construction. 

3. SKILL Devise Means And Asess Apprentice 

Work-Related Attitudes And Values $ 

1. Among the categories of concern you should have 
considered are: 

a. Trustworthiness/dependability 

b. Work habits/patterns 

c. Quality performance 
' d. Personal standards 



2. 



3. 



Advantages of use of rating scale include: 

a. Numerical value to behavior 

b. Comparable ratings for each apprentice 

c. Emphasis on all important points 

d. Ratings at regular intervals 

The elements that the anecdotal record must include 



are: 



a. Identification of individual apprentice 

b. ' Date of occurrence of critical ^incident 

c. Accurate description of ingdent 

4. SKILL Discuss Individual Evaluation Results 

With Apprentice Learners y 

1. The four major benefits of distussing test results with 
apprentices are: 

a. Stimulate and clarify learning task 

b. Serve as a study aid * 

c. Provide a reward 

d. Engender appropriate work attitudes 



a. Stan on time and use time efficiently 

b. Make the apprentice comfortable 

c. Assume the role of a supervisor 
d Be frank and open 

e. Offer evidence to support the topics of discussion 

f. Listen to and address the apprentices^ concerns 

g. Don't let the discussion carry over negatively to 
the classroom \ 

h. Follow topics outlined in agenda 

i. Encourage, training goal setting on the part of the 
apprentice 

j. Agree on goals for the next training period 

5. SKILL Develop Instrumentation To Certify Skills 
And Knowledges Upon Completion 
Of Program Of Course 

1.* Reasons for maintaining certification records: 

a. Satisfying the legal aspects of the apprenticeship 
agreement: 

— Certifying that apprentices completed required ■ 
instruction 

— Certifying that apprentices possess necessary 
skills 

— Providing information for reimbursement for ' 
training sponsors A 

~> 

b. Keeping track of apprentice learning activities in 
order to make instructional decisions 
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Posttest 

Directions. Read the folliwtng question* and write your answers in the spates provided. Check your answers tilth the 
suggested ansu ers that Jollou the questions. IJ you answer at leqst 70 percent of the questions correct!}, continue your work 
v m \todule*10. 1/ not, repeat the sections of this module with uwicb you had greatest difficulty 

1 Arrange the following types of tests from most realistic to least realistic, 

a. , Stimulation - situation 

b. Work sample 

^ - - c Knowledge - identification 

Answer , , , and , * 



2. Which of the following items is Not* rule for writing multiple choice test items? 
a Present only one closely formulated idea in each question. 

0 

b Construct about four alternatives for each item, 
c Csq irrelavant information as detractors ip the alternatives * - 

& Avoid, where possible, correct alternatives that are gramatically different from the question. 
t& 

Read short answer items numbered 3, 4, and 5 and indicate the limitations of each item in the space provided. 

3 The formulas for determining the area of different types of shapes are different. For example, the formula for 
calculating the area of a triangle is A = x h bh The formula for calculating the area of a rectangle is 



Limitations, 



4. What scientific principle or law explains why objects in motion tend to remain in motion in a straight line until an 
external force is exerted upon the object? ■ . 

Answer. : , r 



Limitations 



5. What effects does posture of the listener have on the Speaker during a conversation? Answer. 

,and , y 

Limitations. . 1 

6 Select the letter of one kind of test for which checklists are useful. 

a. Work sample 4 x 

b. Knowledge - recall 

e. Simulation - situation 
7. Select the letter of the item that is least critical to include in a set of test directions: 

a. test purpose * 

b. time available for testing 

c. how to record answers , 

d. "type of test being used . * 
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8. Critique the following test item, listing the limitations of the Hem. 

Which of the following rules is not a safety rule for using a hammer properly? 

a. Don't pound with shank of hammer. 

b Always tap <?bject lightly before hard strike to set eye. 

c Avoid pounding sharp objects with mallets. 

d. Never strike wood or plastic handled chisels. 

Problem include: 

9 List the four cautions associated with assessing work-related attitudes, 
a. , 
b. 
c 
d 

10. What two types of instruments are recommended for assesing work-related attitudes? 
Answers ' and ^ — : 



11. Which of the following reasons for discussing test results with individual apprentices is the weakest reason 7 

a. provides a reward 

b. serves as a study aid 

c. develops appropriate work attitudes 

d. stimulates and clarifies the learning task 

e. punishes learner for wrong answer « • » 

12. Identify the six procedural guidelines for conducting individual conferences, 
a. 

b. 

c. - * 

d. . \ 
e. 

f. , 

0 ' 

13. Circle each of the following items that is an important reason for maintaining careful training records. 

a. motivate trainees 

b. report results or outcomes to the program sponsor , 
c provide information to guide reimbursement ' 

d, facilitate making instructional decisions 
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,30 " Evaluating Apprentice Performance 



Read ea^b of the follouing related subjects situation*. Based on the information, suggest the most appropriate type of test 
for use. . . . 

^ 14 Harmon Milter, a related subjects instructor in an electrical training program, "was completing a unit in basic science. 
He had been teaching the concepts of circuits, resistance and current and had used many working models in class for 
demonstration purposes He still had the models and wanted to be ^jre that the apprentices could find answers to 
problems about current and resistance in realistic circumstances. What kind of a test would you recommend he 
construct? » 

Answer . : 

\^ Jenn> Simpkins teaches blueprint reading and measurement in a sheet metal apprenticeship program. Her major goal 

was to injure that the apprentices in her charge be able to read blueprints and use micrometers correctly, What kind of 
• a test would you recommend she develop? 



Answer- _ ^ 



16 Rinaldu Tantacu teaches all first > ear apprentices in a general construction program. He has just completed a unit on 
the history of apprenticeship. What type of test would you recommend' that /e give? ' 



Answer 



25 
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Appendix 31 



Answers To Posttest 



1. b,a, and c ✓ *. # . 

2. . c 

• 3. Ambigious and contains unnecessary information. 

4. Non6. It is a good question. 

5. Answer blanks are nof uniform and provide clues. 

6. a * • ' - 'A 

7. d . 

8 Double negative construction, use of never, use of always, failure to emphasize "not", correct answer is clearly 
different. (Count it correct if you listed at least three.) 

9. ' a. w Treat information confidently 

b. Allow for the possibility of errors in judgement 

c. Test apprentices as individuals, equals, and with dignity 

d Use as many samples of behavior as possible to draw conclusions. (Count it correct if vqu listed all four.) 

10. Anecdotal records and rating scales 

11. e 

12. a. Establish and follow agenda 

b. Schedule and post conference timesland locations 

c. Review information or topics on agenda and make notes on conversation . ~ 

d. Use time effectively/efficiently 

e. Assume role of foreman 

f. Behave systematically in addressing planned conversation. (Count it correct if you listed at least five.) 

13. You.should have circled items a, b, c, d, and e. (Count it correct if you marked at least four.) 

14. Simulation - work-setting or situation 

15. * Simulation - work-setting or situation 

16. Knowledge - identification and/or recall 
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